- 1 - 



CFO18094US 



OPHTHALMOLOGIC IMAGE PICKUP SYSTEM 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention mainly relates to an 

ophthalmologic image pickup system that performs 
image processing on images picked up by plural kinds 
of eye fundus cameras. 
Related Background Art 

10 Up to now, in an ophthalmologic apparatus such 

as an eye fundus camera that observes an eye fundus 
of an eye to be examined and picks up an image 
thereof or a slit lamp (slit lamp microscope) that 
observes an anterior segment of the eye and picks up 

15 an image thereof, a 35 mm-film or an instant camera 

is used as a recording member. In order to prevent an 
image reader from image-reading and diagnosing an eye 
to be image-picked-up in a state in which the top, 
the bottom, the right, and the left thereof are 

20 erroneously judged, an image pickup device is 
designed such that each film becomes the same 
composition. 

On the other hand, in recent years, there has 
been proposed a system in which a CCD camera is 

25 connected and incorporated and a picked-up image of 
the eye to be examined is displayed on a screen and 
outputted to a recording device such as a magneto 
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optical disk or a video printer. Therefore, according 
as digitization of the image progresses, image 
reverse, contrast adjustment, and light-and-dark 
adjustment are electronically performed on the 
5 picked-up image. Alternatively, a protrusion of an 
aperture mask provided in a silver-salt film so as to 
facilitate distinguishment of the eye to be image- 
pi cked-up is electronically synthesized . 

According to an example disclosed in, for 

10 example, JP 10-179523 A, when the digital camera is 
connected with the ophthalmologic apparatus such as 
the eye fundus camera, the picked-up image is 
subjected to reverse processing and displayed. On the 
other hand, when it is not connected, the reverse 

15 processing is not performed. 

According to a method disclosed in JP 07-124121 
A, the shape of an aperture portion is stored as 
numerical data to reduce a necessary memory capacity. 
Also, according to an apparatus that adds 

20 additional information to an electronic image and 
uses a resultant image, as disclosed in JP 2000- 
023918 A, information indicating whether or not an 
image is required to be stored during image pickup is 
inputted by an additional information input unit. 

25 After the completion of the image pickup, whether or 
not the image is deleted is determined based on the 
information inputted by the additional information 
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input unit. 

Further, when an image of the eye fundus of the 
eye to be examined is picked up by Fluorescein fundus 
angiography (hereinafter referred to as an "FAG image 
5 pickup") using the eye fundus camera, it originally 
becomes a greenish color image. In general, because 
of ease of image reading, the greenish color image is 
converted into a white-and-black image, and y 
characteristic adjustment and contrast processing are 

10 performed thereon for diagnosis. In addition, even in 
Indocyanine green angiography (hereinafter referred 
to as an "ICG image pickup") , similarly, the y 
characteristic adjustment and the contrast processing 
are performed for diagnosis in many cases. 

15 However, in order to prevent an image reader 

from image-reading and diagnosing the eye to be 
image-picked-up in a state in which the top, the 
bottom, the right, and the left thereof are 
erroneously judged, not all kinds of current 

20 ophthalmologic apparatuses are designed such that 

each film becomes the same composition. For example, 
as regards the aperture mask as well, there are 
various apparatuses; some apparatuses include a 
member but other apparatuses do not include the 

.25 member. 

Therefore, in order that the electronic image 
picked up by each ophthalmologic apparatus is 
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captured, an image processing apparatus specialized 
to each ophthalmologic apparatus is required. 

If a single image processing apparatus is used 
for all ophthalmologic apparatuses, a problem in 
5 which the operator needs to set necessary image 
processing for each ophthalmologic apparatus is 
caused. In addition, a fear that erroneous setting is 
performed by the operator cannot be eliminated. 

Also, when the FAG image pickup is performed, 

10 the operator should perform operations such as 

conversion of color information into white-and-black 
information, setting of the y characteristic, and 
contrast enhancement with respect to the picked up 
color electronic image using the image processing 

15 apparatus. Therefore, operation efficiency is low. 
Even in the ICG image pickup, operations other than 
the color information conversion are performed as in 
the FAG image pickup. 

20 SUMMARY OF THE INVENTION 

The present invention has been made to solve the 
above-mentioned problems and accordingly, an object 
of the present invention is to provide an 
ophthalmologic image pickup system capable of 

25 processing information obtained by a plurality of 
image pickup devices by using a single processing 
apparatus. 
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In order to achieve the above-mentioned object, 
an ophthalmologic image pickup system according to 
the present invention includes: a plurality of image 
pickup devices, each of which has image data 
5 generating means for picking up an image of an eye to 
be examined to generate image data; device 
information determination means for determining 
inputted device information related to the image 
pickup devices; and image processing means for 
10 performing different image processings on the image 
data in accordance with a result of the device 
information determination means. 

BRIEF DESCRIPTION OF THE DRAWINGS 
15 Fig. 1 is a structural diagram showing an 

embodiment in which the present invention is applied 

to an eye fundus camera; 

Fig. 2 is an explanatory view showing an image 

picked up by an eye fundus camera A; 
20 Fig. 3 is an explanatory view showing an image 

picked up by an eye fundus camera B; 

Fig. 4 is an explanatory view showing data to be 

transmitted; 

Fig. 5 is a flow chart showing image processing; 
25 Figs. 6A and 6B are explanatory views each 

showing processing of the image picked up by the eye 
fundus camera A; 
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Figs. 7A, 7B, 7C and 7D are explanatory views 
each showing processing of the image picked up by the 
eye fundus camera B; and 

Fig. 8 is a structural diagram showing another 
5 embodiment of the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention will be described in 
detail with reference to embodiments shown in the 

10 drawings. 

In Fig. 1, outputs of digital eye fundus cameras 
A and B are connected with an image processing 
apparatus X. The eye fundus camera A includes an 
image data generation unit 1 and a device information 

15 generation unit 3. The eye fundus camera B includes 
an image data generation unit 2 and a device 
information generation unit 4. The image data 
generation units 1 and 2 each pick up an eye fundus 
image of an eye to be examined and generate an eye 

2 0 fundus image as image data. The device information 
generation units 3 and 4 each generate information 
related to a device (eye fundus camera) that has 
performed image pickup and add the information to the 
generated eye fundus image. The common image 

25 processing apparatus X is provided for the eye fundus 
cameras A and B. Outputs of the image data generation 
units 1 and 2 of the eye fundus cameras A and B are 
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connected with a device information determination 
unit 5 of the image processing apparatus X. An output 
of the device information determination unit 5 is 
connected with a control unit 7 through an image 
5 processing unit 6. The control unit 7 is connected 
with a patient information input unit 8, a memory 
unit 9, and a monitor 10. 

For example, when an image of the left eye of a 
subject is picked up, the eye fundus image which is 

10 the image data generated by the eye fundus camera A 
is as shown in Fig. 2 in a stage in which the eye 
fundus image has been transmitted to the image 
processing apparatus X. That is, an aperture mask 
indicating an image pickup area is provided in the 

15 eye fundus camera A (in the device) . Note that the 
top, the bottom, the right, and the left of the eye 
fundus region are picked up as in a conventional case. 

On the other hand, the aperture mask is not 
provided in the eye fundus camera B (in the device) . 

20 In addition to this, because the eye fundus image is 
formed on an image pickup device in a vertically and 
horizontally reversed state with respect to the case 
of the eye fundus camera A, even when an image of the 
same eye fundus is picked up, image data in which the 

25 aperture mask indicating the image pickup area does 
not exist is obtained as shown in Fig. 3. 

Also, the device information generation units 3 
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and 4 each generate device information for specifying 
which processing should be performed on the eye 
fundus image and transmit the image data to which the 
device information is added as shown in Fig. 4 to the 
5 image processing apparatus X. 

Here, the device information data generated by 
each of the device information generation units 3 and 
4 includes "T 0 P Q R" . More specifically, codes of 
processings 0 and P related to reverse processing of 
10 the image, a code of processing Q related to the 

aperture mask, and a code of processing R related to 
an image pickup mode follow an identification code T 
indicating the presence of information related to 
processing, and are defined as shown in Table 1. 



15 

Table 1 



Processing 


Numerical value 
0 


Numerical value 
1 


Numerical value 
2 


0 


Image horizontal 
reverse not needed 


Image horizontal 
reverse executed 




P 


Vertical reverse 
not needed 


Vertical reverse 
executed 




Q 


Aperture mask 
synthesization not 
needed 


Aperture mask 

additional 
synthesization 
executed 




R 


Color image 


FAG image 


ICG image 



According to the processing R, any processing is 
not performed in the case of a color image. In the 
20 case of an FAG image, while considering ease of 
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diagnosis, it is converted into a white-and-black 
image, and y characteristic adjustment and contrast 
processing are performed thereon. In addition, even 
in the case of an ICG image, it is considered to 
5 perform the y characteristic adjustment, the contrast 
processing, and the like. 

Next, operations will be described according to 
an operation flow of a flow chart of Fig. 5. First, 
it is considered that the FAG image pickup is 

10 performed using the eye fundus camera A. In Step SI, 
patient information such as a patient ID number of a 
subject, a name thereof, a birth date thereof, or a 
sex thereof is inputted from the patient information 
input unit 8 to the control unit 7 of the image 

15 processing apparatus X before image pickup by a 
person that performs image pickup. 

In Step S2, an image of the eye fundus of the 
eye to be examined is picked up using the image data 
generation unit 1 of the eye fundus camera A. In 

20 Steps S3 and S4, the image data generation unit 1 
adds onto the image data the device information 
generated by the device information generation unit 3 
connected therewith as additional information. In 
this case, the device information becomes "T 0 0 0 1" 

25 because the eye fundus camera A is used. 

In Step S5, the image data to which the device 
information is added is inputted to the device 
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information determination unit 5 of the image 
processing apparatus X. In Step S6, the device 
information is read out from the inputted image data 
by the device information determination unit 5 and 
5 processing required for the image data is determined 
thereby. 

In Step S7, processing is selected based on the 
determination result . 

In this case, the device information is "T 0 0 0 

10 1". Therefore, in the image processing unit 6, the 
horizontal reverse and the vertical reverse are not 
performed and it is unnecessary to synthesize the 
aperture mask. However, because of the FAG image 
pickup, in Step S8, the color image is converted into 

15 the white-and-black image, the y characteristic is 
adjusted, and the contrast processing is performed. 

Fig. 6A shows the image transmitted from the eye 
fundus camera A and Fig. 6B shows the image processed 
by the image processing unit 6. Note that it is 

20 originally considered in Fig. 6B that a blood vessel 
is displayed in white and an eye fundus segment is 
displayed in gray. However, they are reversely shown 
in Fig. 6B to easily understand a change. In Step S7, 
the image data processed by the image processing unit 

25 6 is transmitted to the control unit 7, and then 

stored in relation to the patient information such as 
the patient ID number in the memory unit 9 and 
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displayed on the monitor 10 if necessary. 

In the case of color image pickup using the eye 
fundus camera B, after Step SI in Fig. 5, the color 
image pickup is performed by the image data 
5 generation unit 2 of the eye fundus camera B in Step 
S2. In Steps S3 and S4, device information "Till 
0" is generated by the device information generation 
unit 4 and added to image data. 

The image data is transmitted in Step S5. After 

10 that, in Step S6, device information is read out by 
the device information determination unit 5 and 
adequate processing is performed on the transmitted 
image data thereby. 

In this case, because the device information is 

15 "T 1 1 1 0", Step S8 is selected in Step SI. 

Therefore, in the image processing unit 6, the 
horizontal reverse and the vertical reverse are 
performed and the aperture mask is synthesized. 
However, the y characteristic adjustment and the like 

20 are not performed because of the color image pickup. 

Fig. 7A shows the image which is transmitted 
from the eye fundus camera B and overlapped with 
addresses 1, 2, 3, 4, ... for explanation. Fig. 7B 
shows the image which is horizontally reversed by the 

25 image processing unit 6. In the reverse processing, 

only the arrangement may be reversed without changing 
rows of addresses. 
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Subsequently, vertical reverse processing is 
performed. As shown in Fig. 7C, the horizontally 
reversed image may be located such that a first row 
address thereof becomes a final row. Further, the 
5 image is electronically synthesized with an aperture 
mask, thereby obtaining the image as shown in Fig. 7D. 
Finally, as in the above-mentioned case, after the 
image shown in Fig. 7D is transmitted to the control 
unit 7 in Step S8, in Step S9, the image is stored in 

10 relation to the patient information such as the 

patient ID number in the memory unit 9 and displayed 
on the monitor 10 if necessary. 

Also, it is possible that the system is 
specialized to processing on the image data according 

15 to the image pickup mode as follows: an image pickup 
information generation unit that generates 
information related to an image pickup mode is used 
instead of the device information generation unit 
described in this embodiment and the device 

20 information determination unit 5 is replaced by an 
image pickup information determination unit. 

Further, the horizontal reverse processing and 
the vertical reverse processing are separately 
performed in this embodiment. However, because it is 

25 determined whether or not the two processings are 
performed at a time when the device information is 
read, it is needless to say that the processings may 
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be performed at the same time. 

Also, in this embodiment, the image data to 
which the device information is added as tag 
information is transmitted to the image processing 
5 apparatus X. In addition to this, it is considered 

that the image data is transmitted using, for example, 
serial communication or parallel communication* As 
shown in Fig. 8, in this case, an image data 
generation unit 11 and a device information 

10 generation unit 12 are provided in an eye fundus 

camera C and the image processing apparatus X has the 
same structure as shown in Fig. 1. 

The image data "001" picked up by the image data 
generation unit 11 is transmitted to the image 

15 processing unit 6 through the device information 
determination unit 5 of the image processing 
apparatus X using, for example, a USB or an IEEE1394. 
In addition, the device information "001'" 
corresponding to the image data "001" is generated by 

20 the device information generation unit 12 and 

transmitted to the device information determination 
unit 5 using, for example, an RS232C in the case of 
serial communication or a PC-bus in the case of 
parallel communication. A content of the device 

25 information "001'" is based on a format described 

earlier in Table 1: first data (code) T corresponds 
to a command indicating the device information and 
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The image processing unit 6 processes the image 
data according to the result of the device 
information determination unit 5. After that, the 
5 image data is stored in relation to the patient 
information such as the patient ID number in the 
memory unit 9. 

Further, with respect to another embodiment, 
"TS" is used as the information generated by the 
10 device information generation unit 12. That is, only 
a content which can specify the apparatus is used as 
shown in Table 2 below. 



Table 2 



s 


Numerical value 
0 


Numerical value 
1 


Numerical value 
2 




Eye fundus camera 
A 


Eye fundus camera 
B 


Eye fundus camera 
C 



15 



On the other hand, when the image processing 
apparatus X has an image processing table 
corresponding to a processing content of the image 
data as shown in Table 3 below, the same effect can 
20 be obtained. 
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Table 3 





Processing content 


Eye fundus 
camera A 


no processing 


Eye fundus 
camera B 


Horizontal reverse and vertical reverse, 
and electronic mask synthesization 


Eye fundus 
camera C 


Vertical reverse 



Alternatively , as shown in Table 4, it is 
considered that S U" is used as device information 
5 and the device information is transmitted to the 
image pickup mode generation unit 11. 



Table 4 





Numerical value 0 


Numerical value 1 


Numerical value 2 


s 


Eye fundus camera A 


Eye fundus camera B 


Eye fundus camera C 


V 


Color image 


FAG image 


ICG image 



10 Note that the device information in Table 4 

includes detail processing settings as shown in Table 
5 below. 
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Table 5 



Eye fundus camera A 














Color image No image processing 

FAG image -> White-and-black conversion, 

ICG image -+ Contrast=75 


Y 


value= 


■0. 


45, 


Contrast = 


65 


Eye fundus camera B 














Color image -+ No image processing 

FAG image White-and-black conversion, 

ICG image y value=0.46, Contrast=75 


Y 


value= 


0. 


48, 


Contrast = 


60 


Eye fundus camera C 














Color image No image processing 

FAG image -> White-and-black conversion, 

ICG image -> y value=0.49, Contrast=75 


Y 


value= 


0. 


43, 


Contrast = 


68 



Therefore, for example, even in processing 
related to the same FAG image pickup, the extent of 
5 the y characteristic adjustment, the contrast 

processing, and the like can be set in detail for 
each image pickup device. 

Also, in the above-mentioned embodiment, the 
device is constructed that the device information or 
10 the image pickup information is generated therein. It 
is also conceivable that the information is directly 
inputted by an examiner. 

Here, aspects of the present invention are 
described below. One aspect of the present invention 
15 relates to an ophthalmologic image pickup system, 

including: a plurality of image pickup devices, each 
of which has image data generating means for picking 
up an image of an eye to be examined to generate 
image data; device information determination means 
20 for determining inputted device information related 
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to the image pickup devices; and image processing 
means for performing different image processings on 
the image data in accordance with a result of the 
device information determination means. 
5 In the image pickup system, preferably, the 

image pickup device information includes information 
related to at least one of processing for vertically 
reversing the image data and processing for 
horizontally reversing the image data. 

10 According to the aspects, when an image pickup 

device is designed, it is unnecessary to take into 
consideration the number of imaging of an image and 
the number of reflection by mirrors. Therefore, the 
flexibility in design is improved and cost reduction 

15 can be achieved. 

Also, in the ophthalmologic image pickup system, 
preferably, the image pickup device information 
includes information related to synthesis of the 
image data with an electronic aperture mask. 

20 According to this aspect, the aperture mask is 

not necessarily provided in the image pickup device. 
Therefore, cost reduction can be achieved. 

Further, another aspect of the present invention 
relates to an ophthalmologic image pickup system, 

25 including: a plurality of image pickup devices having 
image data generation means, each of which picks up 
an image of an eye to be examined to generate image 
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data thereof; device information determination means 
for determining inputted device information related 
to the image pickup device; a processing table in 
which the corresponding image pickup device and an 
5 image data processing method therefor are shown; and 
image processing means for performing different image 
processings on the image data in accordance with a 
determination result of the device information 
determination means and the processing table. 

10 According to this aspect, it is unnecessary to 

use an image processing apparatus that captures image 
data for each image pickup device and performs image 
processing thereon. That is, the plurality of image 
pickup devices can be treated by the single image 

15 processing apparatus, thereby achieving cost 

reduction. In addition, it is unnecessary to take 
into account a kind of device, so that an error is 
prevented and the operation is easy. When the image 
pickup device is designed, it can be designed without 

20 considering an output image of the image data, so 

that the degree of freedom of the design is increased. 
In addition, when a new image pickup device is used, 
it is necessary to merely update the processing table. 
Further, in the ophthalmologic image pickup 

25 system, preferably, the device information includes a 
description of a kind of the image pickup device. 

According to this aspect, the device information 
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can be simplified. 

Further, in the ophthalmologic image pickup 
system, preferably, the processing method shown in 
the processing table relates to at least one of 
5 processing for horizontally reversing the image data 
and processing for vertically reversing the image 
data . 

According to this aspect, when the image pickup 
device is designed, it is unnecessary to take into 

10 account the number of imaging of the image and the 
number of reflection by mirrors. Therefore, the 
degree of freedom of the design is improved and cost 
reduction can be achieved. 

Further, in the ophthalmologic image pickup 

15 system, preferably, the processing method shown in 
the processing table is to synthesize an electric 
aperture mask with the image data. 

According to this aspect, when the image pickup 
device is designed, it is unnecessary to take into 

20 account the number of imaging of the image and the 
number of reflection by mirrors. Therefore, the 
degree of freedom of the design is improved and cost 
reduction can be achieved. 

In the ophthalmologic image pickup system 

25 according to any one of the aspects of the invention, 
preferably, the image pickup device includes device 
information generation means for generating device 
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information, the device information generation means 
is connected with the image data generation means, 
and the image data generation means adds the device 
information generated by the device information 
5 generation means to the image data and inputs the 
image data to which the device information is added 
to the device information determination means. 

According to this aspect, the number of cables 
provided between the image pickup device and the 

10 image processing apparatus can be reduced and a 

general-purpose format related to the image data can 
be utilized as it is. In addition, erroneous 
processing based on erroneous input can be prevented. 
In the ophthalmologic image pickup system 

15 according to any one of the aspects of the invention, 
preferably, the image pickup device includes device 
information generation means for generating device 
information, and the image data and the device 
information are separately inputted to the device 

20 information determination means. 

According to this aspect, it is unnecessary to 
provide a unit that describes information in a tab of 
the image, so that the device information can be 
relatively easily transmitted using a command. 

25 Further, another aspect of the present invention 

relates to an ophthalmologic image pickup system, 
including: an image pickup device including image 
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data generation means for picking up an image of an 
eye to be examined to generate image data thereof; 
and image pickup information determination means for 
determining inputted image pickup information; and 
5 image processing means for performing different image 
processings on the image data in accordance with a 
result of the image pickup information determination 
means . 

According to this aspect, complicated procedure 

10 of performing image processing on the image data 
after the completion of the image pickup is 
unnecessary, which is time-saving. 

In the ophthalmologic image pickup system, 
preferably, the image pickup device further includes 

15 image pickup information generation means for 

generating image pickup information related to an 
image pickup mode upon image pickup, the image pickup 
information generation means is connected with the 
image data generation means, and the image data 

2 0 generation means adds the image pickup information 

generated by the image pickup information generation 
means to the image data and inputs the image data to 
which the image pickup information is added to the 
image pickup information determination means. 

25 According to this aspect, based on the three 

image pickup modes, no special processing is 
separately performed or such processing can be 
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performed . 

Further, in the ophthalmologic image pickup 
system, preferably, the image pickup mode is one of a 
color image pickup mode, a visible Fluorescein fundus 
5 angiography mode, and an Indocyanine green 
angiography mode . 

According to this aspect, it is unnecessary for 
an operator to perform the operations such as the 
conversion of color information into white-and-black 

10 information, setting of the y characteristic, and the 
contrast processing with respect to the picked up 
visible fluorescence electronic image using the image 
processing apparatus . 

In the ophthalmologic image pickup system, 

15 preferably, the different image processings include 
at least one of conversion of the image data into a 
white-and-black image, y characteristic adjustment 
thereof, and contrast processing thereof when the 
image pickup mode is one of the Fluorescein fundus 

2 0 angiography mode and the Indocyanine green 
angiography mode . 

According to this aspect, the number of cables 
provided between the image pickup device and the 
image processing apparatus can be reduced and the 

25 general-purpose format related to the image data can 
be utilized as it is. In addition, erroneous 
processing based on erroneous input can be prevented. 
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In the ophthalmologic image pickup system, 
preferably, the image pickup device further includes 
image pickup information generation means for 
generating image pickup information related to an 
5 image pickup mode upon image pickup, and the image 
data and the image pickup information are separately 
inputted to the image pickup information 
determination means. 

According to this aspect, it is unnecessary to 
10 provide a unit that describes information in a tab of 
the image, so that the device information can be 
relatively easily transmitted using a command. 

Also, in the above-mentioned system, it is 
preferable that different image processing to the 
15 image data differs according to the image pickup 
device that has performed the image pickup. 

According to this aspect, even in processing 
related to the same FAG image pickup, the extent of 
the y characteristic adjustment, the contrast 
20 processing, and the like can be set in detail for 
each image pickup device. 

As described above, in the ophthalmologic image 
pickup system according to the present invention, it 
is unnecessary to use the image processing apparatus 
25 that captures the image data for each image pickup 
device and performs image processing thereon. The 
plurality of image pickup devices can be treated by 
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the single image processing apparatus, whereby cost 
reduction is achieved. In addition, it is unnecessary 
to take into account a kind of device, so that an 
error is prevented and the operation is easy. When 
5 the image pickup device is designed, it can be 

designed without considering an output image of the 
image data, so that the degree of freedom of the 
design is increased. 



